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OPTIMAL  WHEREABOUTS  SEARCH  FOR  A  MOVING  TARGET 
L.D.  Stone  and  Joseph  B.  Kadane 

Suppose  we  wish  to  find  an  object,  the  target,  which  is  moving  according  to 
known  probability  laws.  The  search  is  assumed  to  last  until  time  T  where  time 
is  discrete  (t  =  0,  . . . ,  T)  or  continuous  (0  <  t  <  T) . 

Such  a  search  may  have  a  number  of  purposes .  A  common  purpose  is  to 
maximize  the  probability  of  detection  by  time  T.  In  this  case  the  search  is 
called  a  detection  search.  A  second  purpose  is  to  localize  the  target  to  within 
one  cell  out  of  a  finite  number  of  cells  defined  by  a  grid  system  of  the  user’s  choice. 
In  this  case  the  searcher  may  succeed  by  detecting  the  target  with  the  search  up 
to  time  T,  or  failing  that,  he  may  guess  one  cell  for  the  target’s  location  at  time  T. 

If  the  guess  is  correct  then  the  searcher  also  succeeds.  This  is  called  a  where¬ 
abouts  search.  A  third  type  is  surveillance  search  in  which  one  seeks  to  maximize 

r 

the  probability  of  correctly  stating  which  cell  contains  the  target  at  time  T.  The 
difference  between  a  surveillance  search  and  a  whereabouts  search  is  that  a  detection 
before  time  T  in  a  surveillance  search  does  not  end  the  search.  It  merely  helps 
to  locate  the  target  at  time  T. 

This  paper  deals  with  the  whereabouts  search  and  shows  that  the  optimal 
whereabouts  search  plan,  i.e.,  an  allocation  of  search  effort  and  a  choice  of  cell 
to  guess,  may  be  found  by  solving  a  finite  number  of  optimal  detection  problems 
for  a  moving  target,  one  for  each  cell  in  the  grid.  Having  shown  this  we  discuss 
how  to  use  the  optimal  detection  search  algorithms  of  Brown  [2],  Stone  et  al  [16], 
and  the  bounds  given  by  Washburn  [18]  to  compute  optimal  whereabouts  search  plans. 
In  the  case  of  a  stationary  target,  as  studied  by  Mela  [6],  Tognetti  [17] »  and 
Kadane  [5],  optimal  whereabouts  search  and  optimal  surveillance  search  coincide 


-1- 


because,  once  the  target  is  detected,  its  location  is  known  with  certainty  from 
then  on  and  in  particular  at  time  T.  In  addition  to  the  results  mentioned  above, 
optimal  detection  search  for  a  moving  target  has  been  studied  by  Stone  [13]  and 
[14],  Stone  and  Richardson  [15],  Persiheimo  [7],  Saretsalo  [10],  Heilman  [4], 
Dobbie  [3],  Pollock  [8],  and  Stewart  [11]. 

In  the  case  where  false  targets  are  present  very  few  results  have  been 
obtained  even  when  the  target  is  stationary;  see  Chapter  VI  of  Stone  [12], 
Richardson  [9],  and  Barker  and  Belkin  [1].  In  this  paper,  we  do  not  consider  the 
problem  of  false  targets . 

Whereabouts  search  might  be  used  in  a  search  and  rescue  situation  in  which 
it  is  known  that  those  lost  can  survive  no  longer  than  T  units  of  time  in  the 
environment.  If  the  searcher  finds  the  lost  party  in  some  search  of  a  cell, 
the  rescue  can  be  effected  immediately.  If  after  time  T  the  party  has  not  been 
found,  the  rescue  effort  is  assigned  to  some  cell  and  will  be  successful  if 
the  lost  party  is  in  fact  in  that  cell.  Similarly  it  might  be  used  in  a  military 
context  in  which  the  object  is  destroyed  as  soon  as  it  is  found,  or  a  weapon  is 
fired  into  the  cell  guessed  after  T  if  the  target  has  not  been  previously  found. 

By  contrast,  if  it  is  desired  to  know  where  the  object  is  at  time  T,  without 
taking  any  action  if  it  is  found  before  T,  a  surveillance  search  problem  results. 
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1.  CHARACTERIZATION  OF  OPTIMAL  WHEREABOUTS  SEARCH 
IN  TERMS  OF  OPTIMAL  DETECTION  SEARCH 

Kadane  [5]  shows  that  solving  the  optimal  whereabouts  search  for  a  stationary 
target  may  be  reduced  to  solving  J  optimal  detection  problems  for  a  stationary 
target  where  J  is  the  number  of  cells  in  the  grid  of  the  target's  probability  distri¬ 
bution.  In  this  section  we  generalize  that  result  to  moving  targets. 

Our  results  apply  to  targets  moving  in  discrete  or  continuous  space  or  time. 
Let  {  X^,  0  <  t<  T}  be  the  stochastic  process  representing  the  target's  motion. 

For  discrete  time,  we  shall  understand  0  <  t  <  T  to  mean  t  =  0, 1, . . . ,  T  in  order 
to  state  results  simultaneously  for  continuous  and  discrete  time.  The  search 
space  may  be  continuous  or  discrete,  but  the  searcher  must  specify  a  whereabouts 
grid  of  cells  for  time  T.  The  size  of  these  grid  cells  must  correspond  to  the 

f 

degree  of  localization  required  for  the  objective  of  the  search.  For  example, 
the  cells  may  be  of  the  size  of  the  lethal  area  of  the  weapon  to  be  fired  at  time  T . 
The  whereabouts  grid  has  no  connection  with  the  target  motion  which  may  be  in 
continuous  space  or  through  a  grid  of  cells  entirely  different  from  the  whereabouts 
grid.  Let  the  whereabouts  grid  have  I  cells  numbered  i.=  1, 2 . 1. 

Let  \[>  be  the  class  of  allowable  detection  search  plans.  A  whereabouts 
search  plan  is  a  search  plan  e  with  which  to  try  to  detect  the  target  and 
a  whereabouts  cell  i  in  the  whereabouts  grid  which  is  guessed  to  contain  the 
target  if  the  detection  search  fails.  Let  S^[ip ,  i]  be  the  probability  of  success 
using  the  whereabouts  search  plan  ,  i) .  We  seek  an  optimal  whereabouts 
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plan  i .  e . ,  a  plan  such  that  ^  *  e  1  <  i*  <  I ,  and 

ST[^  *,  i*]  =  max{  ST[^ ,i]  :  ip  e  *  and  1  <  i  <  1}  . 
th 

Let  C(i)  denote  the  i  cell  in  the  whereabouts  grid  and  let  X*  =  {  X  0  <  t  <  T  j  X  £  C(i)} 

t  *  '  T 

denote  the  target  process  obtained  by  conditioning  on  the  target  not  being  in  C(i)  at 
time  T.  Let  P^,  [ip]  be  the  probability  of  detecting  the  target  with  plan  ip  given 
that  the  target  is  not  in  cell  i  at  time  T.  Then 

ST[^ ,  i]  =  P^.  W ]  (l ■ -  Pr{  XT  e  C(i)})  +  Pr{  XT  e  C(i)}  .  (1) 

Given  that  we  choose  to  guess  cell  i  at  time  T,  it  is  clear  that  we  should  choose 

the  detection  search  plan  ip1  to  use  with  i  so  that  ip1  maximizes  P^.  Since  I  is 

finite  it  is  also  clear  that  we  can  find  the  optimal  whereabouts  plan  by  performing 

i* 

I  optimizations  to  determine  (ip  ,  i*) ,  such  that 

S^1  ,i*]=  max  S  [ip1, i]. 

T  i<i<i  T 

Since  finding  ip1  is  simply  finding  an  optimal  detection  plan  for  a  target  moving 
according  to  the  stochastic  process  X1,  we  have  shown  that  the  optimal  where¬ 
abouts  problem  reduces  to  solving  I  moving  target  detection  problems.  We 
state  this  observation  as  a  theorem. 
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THEOREM.  Let  ^g^be  an  optimal  detection  plan  for  the  target  motion  process 
X1,  U. , 

P^W1]  =  max{  :  * Pe*}. 

Then  an  optimal  whereabouts  search  plan  is  ( ip **,  i*)  where 

S  [ip1*,  i*]  =  max  S-T[tf\  i]. 

1  l<i<I 

Observe  that  there  are  no  restrictions  on  the  class  of  detection  plans  from 
which  we  are  allowed  to  choose.  For  example,  the  above  result  applies  to  where¬ 
abouts  problems  in  which  ^  is  a  class  of  search  paths  or  a  collection  of  functions 
which  specify  the  allocation  of  search  effort  in  space  and  time. 

r 

Clearly  the  above  result  may  be  extended  to  whereabouts  problems  in  which 
the  searcher  is  allowed  to  choose  n  >  1  whereabouts  cells  for  the  target's  location 
if  the  detection  search  fails. 
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2.  ALGORITHMS  FOR  COMPUTING  OPTIMAL  WHEREABOUTS  PLANS 


Using  the  result  of  the  theorem  we  now  show  how  one  may  modify  the  algorithm 
of  Brown  [2]  or  the  one  of  Stone,  et.  al.  [16]  (both  of  which  are  designed  to  compute 
optimal  detection  plans)  to  compute  optimal  whereabouts  plans. 

These  algorithms  are  designed  for  discrete  time  searches  and  assume  that 
there  is  a  grid  of  J  cells  in  the  plane  over  which  search  is  allocated.  This  is  the 
search  grid.  A  search  plan  $  is  a  non-negative  function  of  space  and  time  such  that 

ip  (j,  t)  =  effort  placed  in  cell  j  at  time  t  for  j  =  1 . J,  t  =  1, . . . ,  T. 

We  are  restricted  to  the  class  \&(m)  of  plans  ip  such  that 

J 

2  ^(j,t)  =  m(t)  for  t  =  0 . T. 

j  =  l 

Effort  cannot  be  transformed  from  one  time  period  to  another. 

The  detection  function  is  exponential  with  sweep  width  which  may  vary  over 

th 

space.  Let  W(j)  and  A(j)  be  the  sweep  width  in  an  area  of  the  j  cell  for  j  =  1, . . . ,  J. 
Then  we  assume 

PT[ip)  =E[l-exp(-JoWCXs)^pCs,s)/A(Xe))]  (2) 

where  E  indicates  expectation  over  the  sample  paths  of  the  process  and  X  is 

s 

the  cell  that  the  process  is  in  at  time  s. 

When  target  motion  is  modeled  by  a  mixture  of  discrete  time  and  space  Markov 
processes  and  the  detection  function  is  exponential,  the  algorithm  of  Brown  [2] 
provides  an  extremely  efficient  method  of  computing  optimal  detection  plans. 

If  our  target  motion  process  X  falls  into  this  category,  then  we  may  modify 
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Brown’s  algorithm  to  find  Pr{  XT  e  C(i)}  ,  ty1,  and  P^,[^1]  as  follows. 

Let  c(j)  for  j  =  1, . . . ,  J  indicate  the  cells  in  the  search  grid.  The  target  moves 

e. 

among  the  cells  in  the  search  grid  and  each  cell  C(i),  i  =  1, ....  I  in  the  whereabouts 
grid  is  composed  of  an  integral  number  of  cells  from  the  search  grid.'  Let  be 
the  search  plan  which  assigns  zero  effort  everywhere.  Using  Brown’s  notation 
we  first  choose  a  whereabouts  cell  C  (i)  and  compute 

Pr{X  e  C(i)}  =  2  reach  (c(j),T,^°). 

{j  :c(j)  e  C(i)} 

Here  we  are  simply  using  the  initial  distribution  at  time  1  and  iterating  the 
transition  matrix  of  the  Markov  process  (or  processes)  to  compute  Pr[  X^  e  C(i)}  . 
We  modify  the  initialization  of  the  survive  matrix  by  setting 


survive  (c(j),T ,ip) 


0  if  c(j)  e  C(i) 

for  j  =  1, . . . ,  J, 

1  if  c(j)  i  C(i) 


for  any  search  plan  $ .  The  result  of  modifying  the  survive  matrix  in  the  above  manner 
is  to  remove  the  paths  which  end  in  whereabouts  cell  C(i)  at  time  T.  Once  can 
show  that  the  resulting  process  X1  is  still  Markovian  if  X  is  Markovian  or  a 
mixture  of  Markov  processes  if  X  is  a  mixture  of  Markov  processes.  In 
either  case  Brown’s  [2]  algorithm  is  applicable  to  X1  and  is  used  to  compute  an 
optimal  plan  and  probability  of  detection  for  that  plan.  The  resulting  plan  will 
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be  ip1  and  the  resulting  probability  of  detection  will  be  (1-Pr{  X^e  C(i)}  ). 

By  doing  this  for  each  whereabouts  cell  C(i),  i  =  1, . . I,  and  by  choosing  the 
i* 

pair  (ip  >  i*)  with  the  highest  probability  of  success  as  calculated  by  equation  (1), 
we  have  found  the  optimal  whereabouts  plan. 

Rather  than  perform  the  two  step  procedure  of  calculating  Pr[  XT  e  C(i)}  and 
P  [^Kl-Prf  XT  e  C(i)}  ),  it  is  more  efficient  to  minimize  failure  to  detect  using 
the  defective  process  obtained  from  the  above  initialization  of  the  survive  matrix. 

The  resulting  probability  will  be 

F1  =  (l-P1T[/])(l-Pr{XTeC(i)}) 

and 

l-F1  =  Pr{XTe  C(i)}  +P^1]  (1-Pr{  XTe  C(i)}  ) 

=  ST0\i]. 

Actually  Brown's  algorithm  is  an  iterative  one  which  converges  to  the  optimal 

plan  in  an  infinite  number  of  steps.  However,  after  each  iteration  in  the  algorithm 

one  obtains  a  lower  bound  (the  probability  of  detection  for  the  plan  obtained  from  that 

iteration)  and  an  upper  bound  by  the  method  of  Washburn  [18]  (see  Section  4).  These  in  turn 

may  be  converted  to  upper  §  [tfl,i]  and  lower  S^V]  bounds  forST[^\ i]  by  using  equation  (1). 

With  these  bounds  one  can  save  computing  time  by  using  a  branch  and  bound  technique. 

That  is,  one  specifies  a  tolerance  e  for  how  close  to  the  success  probability  of 

the  optimal  plan  he  wishes  to  come.  Choose  an  initial  whereabouts  cell  i1  and 
i'  i' 

iterate  until  S^[^  ,i']  -  S[^  ,i']  <  e  .  For  each  succeeding  choice  of  a  whereabouts  cell 
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i  -  i  i'  i  -  i' 

C(i)  stop  the  iteration  to  determine  ip  if  either  ,  ij  <  S^[tp  ,  i’]  or  S ^[ip  ,i]  >  ,i']. 

i» 

If  the  former  occurs,  retain  (ip  ,  i')  as  the  candidate  optimal  plan.  If  the  latter  occurs, 
then  replace  i'  with  i  and  continue  iterating  until  the  tolerance  e  is  met  for  the  new 
candidate  i'.  If  one  cannot  decide  between  two  possible  solutions  on  the  basis 
given  above  (i.e. ,  the  tolerance  interval  for  one  plan  overlaps  the  other),  then 
one  can  choose  between  them  in  an  arbitrary  fashion.  For  example,  one  could 
choose  the  one  with  the  higher  lower  bound.  In  this  way  one  will  be  guaranteed  to  obtain 
a  solution  within  the  desired  tolerance. 

If  the  target  motion  is  more  general  than  a  mixture  of  discrete  space  and  time 
Markov  processes,  then  one  can  modify  the  algorithm  in  Chapter  IV  of  Stone,  et.  al. 

[16]  as  follows. 

r 

Using  the  notation  of  Stone,  et.  al. ,  [16]  we  sort  the  sample  paths  by  which  cell  in 

the  whereabouts  grid  contains  the  target  at  time  T.  Choose  a  whereabouts  cellC(i).  To  obtain 

Pr(XTe  C(i)}  ,  we  sum  the  probabilities  of  the  paths  ending  in  C(i).  Removing 

these  paths  from  the  file  of  sample  paths,  we  solve  for  ip1,  the  optimal  detection 

search  plan,  using  the  remaining  paths.  The  probability  of  detection  resulting 

from  this  procedure  will  be  P^,[^,1](l-Pr{  X^e  C(i)}  ).  (Again  it  is  more  efficient 

to  minimize  the  failure  probability  on  the  defective  process  obtained  by  removing 

the  paths  ending  in  cell  C(i).  One  minus  this  probability  is  S  [^1,i].)  We  then 

proceed  using  the  above  branch  and  bound  technique  to  find  the  optimal  whereabouts 
i* 

plan  (ip  ,i*)  to  the  desired  tolerance. 
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3.  EXAMPLES  OF  OPTIMAL  WHEREABOUTS  PLAN 


We  give  three  examples  of  optimal  whereabouts  search  plans.  The  first  example 
shows  that  even  when  the  detection  function  is  exponential  and  the  sweep  width  the 
same  in  all  cells,  it  is  not  necessarily  optimal  to  choose  the  cell  with  the  highest 
prior  probability  at  time  T  for  the  whereabouts  cell.  The  second  example  shows 
a  situation  in  which  the  optimal  whereabouts  cell  is  the  one  with  the  highest 
probability  at  time  T  when  no  search  is  applied  at  any  time  period.  The  third 
illustrates  how  the  whereabouts  search  procedure  balances  detection  capability 
against  target  location  probability  in  choosing  the  whereabouts  cell. 

For  the  three  examples  presented  in  this  section  the  whereabouts  grid 
coincides  with  the  search  grid.  The  probability  of  detection  using  plan  tj)  is 
given  by  equation  (2). 

Example  1:  For  stationary  whereabouts  searches,  Kadane  [5]  shows  that  when 
the  cost  and  detection  function  are  the  same  over  all  the  cells  in  the  whereabouts 
grid,  then  it  is  optimal  to  choose  the  cell  with  the  highest  prior  probability  for 
the  whereabouts  cell.  For  whereabouts  searches  involving  moving  targets, 
one  might  conjecture  that  this  result  would  generalize  by  choosing  as  the 
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whereabouts  cell  the  one  with  the  highest  probability  at  time  T  when  no  search 
is  applied.  We  now  show  this  conjecture  to  be  false. 

Let  the  search  and  whereabouts  grid  consist  of  two  cells.  Time  is  discrete 
and  there  are  two  time  periods  for  search,  t  =  0,1.  There  are  three. possible 
target  paths.  The  paths  and  their  associated  probabilities  are  shown  in  Table  1. 

We  use  the  notation  =  (1, 1)  to  mean  that  path  1  is  in  cell  1  at  time  0  and  remains 
in  cell  1  at  time  1.  Table  1  also  shows  the  target  distributions  if  no  search  is 
conducted.  We  see  that  cell  2  has  the  highest  probability  at  time  1.  There  are  two 
units  of  search  effort  available  at  each  time  period,  and  W(j)  =  A(j)  =  l  for  j  =1,  2. 


TA_BLE_1 

r 

a.  TARGET  PATHS  AND  PROBABILITIES 


Note:  €  <  1/4. 


Path 

co1  =  (l,l) 
=  (2,1) 
w3  =(2,2) 


Probability 

e 

^  —  2e 

w 


b.  TARGET  DISTRIBUTIONS 

Target  Distribution  at  Time  0  Target  Distribution  at  Time  1 


Cell 

Probability 

Cell 

Probability 

1. 

e 

1. 

i-e 

2. 

1-e 

2. 

5+e 
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Let  F*  be  the  failure  probability  for  the  whereabouts  plan  which  chooses  cell  j 
for  the  whereabouts  cell  and  allocates  its  detection  search  optimally  for  the 
process  X*1  which  has  the  sample  paths  ending  in  cell  j  removed.  Then  F1  =  1-S^^,  j]. 
Suppose  we  choose  1  for  the  whereabouts  cell.  Since  oj  is  the  only  path  not 

O 

ending  in  cell  1,  the  plan  1  puts  2  units  of  effort  in  cell  2  at  time  0  and  time  1. 

Thus, 


F1  =  (5+e)e~4. 


If  we  choose  2  for  the  whereabouts  cell,  then  ip  places  all  the  effort  for  time 

t  =  1  in  cell  1.  By  Brown  [2]  or  Theorem  2  of  Stone  [14],  we  find  the  optimal 

allocation  at  time  0  by  computing  the  posterior  distribution  at  time  0  (using  only 

co  and  a>  ),  given  failure  to  detect  at  time  1,  and  allocating  the  effort  for  time  0 

2 

to  be  optimal  for  this  posterior  distribution.  If  e  is  small  enough,  then  ip  will 
place  all  effort  in  cell  2  at  time  0  and 

2  -4  -2 

F  =(i-2e)e  +ee  . 

2  1  -2  -2 

Since  F  -F  =ee  (l-3e  )  >  0,  it  follows  that  choosing  cell  1  yields  the  lower 
failure  probability  (higher  success  probability)  and  that  the  optimal  whereabouts 
plan  chooses  cell  1  for  the  whereabouts  cell  rather  than  the  higher  probability  cell  2. 

Observe  that  no  matter  how  small  e  is,  cell  2  has  the  larger  probability  of 
containing  the  target  at  time  1  given  no  search.  By  making  e  small  enough 
the  searcher  is  forced  to  place  all  his  effort  in  cell  2  at  time  0  regardless  of 
which  whereabouts  cell  he  chooses.  However,  searching  in  cell  2  at  time  0 
causes  cell  1  to  be  the  high  probability  cell  at  time  1  given  failure  to  detect 
at  time  0.  Thus  cell  1  rather  than  2  becomes  the  optimal  whereabouts  cell. 
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Example  2;  Uniform  Sweep  Width.  This  example  shows  a  situation  in  which 
the  cell  having  the  highest  probability  of  containing  the  target  at  time  T,  if  no 
search  takes  place, is  the  optimal  one  to  choose  for  the  whereabouts  cell. 

The  target  distribution  at  time  0  is  bivariate  normal  with  center  at  30°  10*  N 
30°10'W.  The  major  axis  is  oriented  east-west,  and  the  standard  deviation  along 
the  major  and  minor  axes  is  50  and  30  nautical  miles,  respectively.  At  time  t  =  3, 
the  target's  distribution  is  circular  normal  with  center  at  28°10'N,  30°  10' W 
and  standard  deviation  10  nautical  miles  along  any  axis.  The  target  paths  are 
obtained  by  making  an  independent  draw  for  the  target's  position  at  time  t  =  0  and 
t  =3  from  the  above  distributions.  The  target  then  follows  a  constant  course 
and  speed  between  these  points .  Four  thousand  sample  paths  were  drawn  to 
represent  the  target  motion  process. 

Figure  1  illustrates  the  target  motion  assumptions  and  shows  some  typical 
target  paths.  Both  the  search  and  whereabouts  grid  consists  of  cells  which 
are  20'  by  20'  as  indicated  in  the  figure.  The  sweep  width  W(j)  =  1  for  all  cells  j, 
and  there  are  1500  units  of  search  effort  available  at  each  time  period.  In  sub¬ 
sequent  figures  we  will  show  only  the  region  of  the  grid  in  which  the  target  location 
probabilities  are  positive. 

Figure  2  shows  the  probability  distribution  in  the  whereabouts  grid  at  time  3  with 
no  search  having  taken  place  at  any  time  period.  The  algorithm  used  to  find  the 
optimal  whereabouts  plan  is  a  modification  of  the  one  given  in  chapter  IV  of  Stone  et  al 
[16j.  It  proceeded  by  choosing  the  highest  probability  cell  in  this  grid  and  computing 
the  optimal  plan  given  this  choice  to  within  a  tolerance  of  .  001.  This  tolerance 
was  reached  at  3  iterations.  An  iteration  consists  of  one  complete  cycle  through 
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FIGURE  1 


TARGET  MOTION  ASSUMPTIONS  FOR 
EXAMPLES  2  AND  3 
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FIGURE  2 


TARGET  DISTRIBUTION  IN  WHEREABOUTS  GRID  AT  TIME  3  WHEN  NO 
SEARCH  IS  APPLIED  DURING  ANY  TIME  PERIOD 
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the  time  periods.  For  convenience  in  referring  to  the  cells  in  the  whereabouts 
grid  in  Figure  2 ,  we  number  them  starting  with  the  bottom  row  and  numbering 
from  left  to  right.  The  highest  probability  cell  is  cell  13.  Table  2  shows  the 
convergence  of  the  algorithm,  which  chooses  cells  in  the  order  of  highest  to 
lowest  probability  in  Figure  2.  Since  the  high  probability  cell  in  Figure  2  is  the 
optimal  whereabouts  cell  for  this  problem,  the  initial  guess  is  optimal  and  the 
remaining  guesses  are  eliminated  very  quickly  after  one  or  two  iterstions 
(see  Table  2).  The  optimization  algorithm  required  702  CPU  seconds  on  a 
Prime  400  minicomputer.  This  time  does  not  include  the  time  necessary  to 
generate  the  sample  paths  for  the  target  motion  process  . 

Figure  £  shows  the  target  distribution  before  search  and  the  optimal 
allocation  of  search  at  times  t  =  0, 1,2,3  for  this  example.  The  rectangle 
in  the  target  distribution  outlines  the  region  in  which  search  is  placed  at 
that  time  period.  Observe  that  no  effort  is  placed  in  the  high  probability  cell 
at  time  0  and  time  3  whereas  substantial  amounts  of  effort  are  placed  in  the 
high  probability  cell  at  times  1  and  2.  Since  the  high  probability  cell  at  t  =  3 
is  also  the  whereabouts  cell,  it  is  clear  that  no  search  should  be  placed  in 
this  cell  at  time  3.  Also,  points  that  start  in  the  high  probability  cell  at  time  0 
are  likely  to  end  up  in  the  high  probability  cell  at  time  3  by  the  way  we  have 
chosen  our  target  paths .  This  explains  why  no  effort  is  placed  in  the  high 
probability  cell  at  time  0 .  However,  at  times  1  and  2  the  high  probability  cell 
contains  points  from  paths  that  start  and  end  on  the  edges  of  the  distributions  at 
times  t  =  0  and  t  =  3  but  cross  over  the  center  at  times  1  or  2 .  Thus  it  is 
profitable  to  search  these  cells.  Figure  4  shows  the  target  distribution  given 
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TABLE  2 


CONVERGENCE  OF  ALGORITHM  TO  OPTIMAL  WHEREABOUTS  PLAN 

Note:  Solution  tolerance  .  001 
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failure  of  the  detection  search. 


Example  3:  Variable  Sweep  Width.  The  assumptions  are  the  same  as  in 
example  2,  except  the  sweep  width  is  1  to  the  east  of  30°  20'  W  and  0.  1  to  the 
west.  If  no  search  takes  place  the  distribution  at  t  =  3  remains  as  given  in  Figure  2. 
However,  the  optimal  whereabouts  plan  for  this  search  does  not  choose  the  high 
probability  cell  in  Figure  2  for  the  whereabouts  cell.  Instead  the  cell  directly 
to  the  west  is  chosen.  The  reason  for  this  is  that  the  optimization  algorithm 
takes  into  account  the  fact  that  it  is  very  difficult  to  search  west  of  30°  20' W 
(i.  e. ,  W  =  0. 1)  and  that  it  is  more  efficient  to  use  search  effort  where  the 
detection  capability  is  high  (i.e. ,  in  the  high  probability  cell)  and  make  the 
wereabouts  guess  in  a  cell  where  detection  capability  is  poor. 

Figure  5  shows  the  target  distribution  and  optimal  search  allocation  for  the 
optimal  whereabouts  search  plan.  The  rectangle  in  the  target  distribution  outlines 
the  area  in  which  search  effort  is  applied.  Figure  6  shows  the  target  distribution 
given  the  detection  search  has  failed  to  find  the  target.  Note,  that  the  whereabouts 
cell  is  now  the  high  probability  cell.  Observe  that  all  search  takes  place  in 
the  area  where  detection  capability  is  good.  However,  no  effort  is  placed  in 
the  high  probability  area  at  time  0  even  though  it  is  in  the  good  detection  region! 

The  detection  probability  at  the  end  of  time  3  is  0,  74  which  is 
higher  than  the  detection  probability  of  0. 66  at  the  end  of  time  3  in  example  2  even 
though  the  sweep  width  is  uniformly  as  large  or  larger  in  example  2  than  in 
example  3.  The  reason  for  this  is  that  the  detection  search  in  example  3  searches 
the  high  probability  cell  at  time  3  in  contrast  to  example  2  which  puts  no  search  in 
that  cell  because  it  is  the  whereabouts  cell.  However  the  probability  of  success  in 

example  2  (0.  86)  is  higher  than  in  example  3  (0.  82). 
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A  glance  at  Figure  6  explains  why  no  search  effort  is  placed  in  the 
poor  detection  region.  Virtually  all  the  target  paths  that  terminate  in  this 
region  are  located  in  the  whereabouts  cell  so  that  no  search  is  required. 
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FIGURE  3 


UNIFORM  SWEEP  WIDTH  EXAMPLE 
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FJ[G_UR_E_3 _ (CO  n_ti_n_u_e_d_)_ 
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F_I GJJ_R_E  _3_ Jco _n_t i.n.u.e_d)_ 

TARGET  DISTRIBUTION  BEFORE  SEARCH  AT  TIME  2 
NOTE*  ENTRIES  HAVE  BEEN  MULTIPLIED  BY  103 
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F_I  G_UR_E  _3_  Jco  _n_t  i  n  u  e  d ) 
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FIGURE  4 


TARGET  DISTRIBUTION  FOLLOWING  UNSUCCESSFUL 
SEARCH  AT  TIME  3  IN  UNIFORM  SWEEP  WIDTH  EXAMPLE 


Notes :  1.  Entries  are  multiplied  by  10. 

2.  The  cell  enclosed  by  the  dashed  lines 
is  the  optimal  whereabouts  cell.  If  the 
target  is  not  detected  by  the  end  of  time  3, 
this  cell  is  guessed  to  contain  the  target. 
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FIGURE  5 


VARIABLE  SWEEP  WIDTH  EXAMPLE 
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F_I  G  JURE.  _5_  _(co  _n_t  i_nu_e_d_)_ 
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FIGURE  5  (continued) 


TARGET  DISTRIBUTION  BEFORE  SEARCH  AT  TIME  2 
NOTE:  ENTRIES  HAVE  BEEN  MULTIPLIED  BY  I03 
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TARGET  DISTRIBUTION  BEFORE  SEARCH  AT  TIME  3 
NOTE*  ENTRIES  HAVE  BEEN  MULTIPLIED  BY  103 
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FIGURE  6 


TARGET  DISTRIBUTION  FOLLOWING  UNSUCCESSFUL 
SEARCH  AT  TIME  3  IN  VARYING  SWEEP  WIDTH  EXAMPLE 


Notes:  1.  Entries  have  been  multiplied  by  10. 

2.  The  cell  enclosed  by  the  dashed  lines  is  the  optimal 
whereabouts  cell.  If  the  target  is  not  detected  by  the 
end  of  time  3,  this  cell  is  guessed  to  contain  the 
target. 
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4.  WASHBURN'S  UPPER  BOUND 


This  section  contains  a  brief  description  of  the  upper  bound  given  by  Washburn  [18]. 
Let  P  be  defined  as  in  equation  (2)  and  let  if>  and  ip  e  T' .  Then 


P IjXipfij-Tj)]  =  lim  -i-  (P  [#+e  -  Py$]) 

e-*0 


is  the  Gateaux  differential  of  P^  at  jp  in  the  direction  ip-ip.  Let  E.^  indicate  expectation 

conditioned  on  X  =  j,  and  define 
t 


W(i) 

DT[*’3’t]  =  Ejt[A0)eXp("^o 


w (Xt)  0  (Xt,  t)/A(Xt)]  pt(j)  for  1  <  j  <  J,  1<  tjcT, 


where  p  (j)  =  Pr{  X  =j}  .  Then  Stone  [14]  shows  that 

L  l 

T  J 

P s  2  D  [^,j,t][Jo,t)-^0,t)]. 
fc=0.j=l 

Since  P^  is  a  concave  function,  one  can  show  that  (see  the  proof  of  Theorem  1  in 
Stone  [14]) 


pyi>]  -  py^]  <  py$,J-^] 

T  J 

=  22  D  [<fi,j,t]  Jo.t)  -  DT[^,j,t] 
t=0  j=l 

For  t  =  0,  . . . ,  T,  let 


X  (t)  =  max{  Dy$,  j,  t]  :  1  <  j  <  j} 

X  (t)  =  min{  Dy  j,  t]  :  1  <  j  <  J  and  $  (j,  t)  >  0}  . 
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Then 


T 

PT[J]  "  PT[^]  <  S  (t)-X (t))  m(t)  for  ^i€$(m). 

1  1  t=l 

This  is  Washburn’s  upper  bound.  Note  that  the  right-hand  side  depends  only  on  ip 
and  the  bound  holds  for  any  ip  (m),  in  particular  for  the  plan  ip  *  which  maximizes 
detection  probability  at  time  T  within  ^  (m).  The  necessary  conditions  of  Stone  [14] 
guarantee  that  X (t)  =  A  (t)  when  ip  =  ip*. 
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